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ABSTRACT 



This study sought to determine which, if any, of the 
possible predictor variables based on relationships with college performance 
available at freshman entry would prove useful in selecting students for 
admission. A study of the relationships between four college performance 
variables and eight admission variables was conducted using seven freshman 
cohorts (summer and fall) at the University of South Florida (USF) . 

Meaningful relationships with all four outcomes occurred for both high school 
grade point average (GPA) and class rank. Although simple relationships with 
outcome variables occurred for other variables such as sex, race/ethnicity , 
and test scores, most of their predictive capacity was already included in 
the GPA-based measures, and they added little to predictions. Even the very 
strongest relationships between predictors and outcomes failed to identify 
meaningful performance differences between any two adjacent scale points. 
Using a standardized 15-point scale (each point included roughly 7% of all 
students) across GPA. Class rank, ACT Assessment, and Scholastic Assessment 
Test scores, attrition differences between adjacent scale points at the 
maximum were about 2.4% and those for meaningful outcomes (graduation and 
retention to the second year) were generally between 0.5% and 2.0%. Even 
without considering the issue of measurement error, these small differences 
in outcomes from scale point to scale point show the fantasy of selecting 
specific admission cutoffs. When one sets a cutoff, no difference in outcomes 
will occur for the students immediately above and below the cutoff in at 
least 97.6% of cases, and almost always in 89 to 99% of cases. T. Mortenson 
(1999) indicates that affluence related far more with graduation and 
retention and could reduce the incorrect decision rate from 98% to perhaps 
70% of rejected applicants. (Author/SLD) 
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Facts and Fantasies Regarding Admission Standards 

Summary 

This study sought to determine which, if any, of the possible predictor variables available at 
freshman entry would prove useful in selecting students for admission based on 
relationships with college performance. A study of relationships between four college 
performance variables and eight admission variables was conducted using seven freshmen 
cohorts (summer and fall) at the University of South Florida (USF). Supporting an 
extensive literature, meaningful relationships with all four outcomes occurred for both high 
school G.P.A. and class rank. Although simple relationships with outcome variables 
occurred for other variables such as sex, race/ ethnicity and test scores, most of their 
predictive capacity was already included in the G.P.A. -based measures, and they therefore 
add little to predictions. Even the very strongest relationships between predictors and 
outcomes fail to identify meaningful performance differences between any two adjacent 
scale points. Using a standardized 15-point scale (each scale point includes roughly 7% of all 
students) across G.P.A., Class Rank, ACT and SAT scores, attrition differences between 
adjacent scale points at the maximum, were about 2.4% (that between high school G.P.A. 
and first year grades) and with meaningful outcomes (e.g. graduation, retention to second 
year) were generally between 0.5% and 2%. Even avoiding the issue of the measurement 
error inherent in all such measures, these small differences in outcomes from scale point to 
scale point show the fantasy of setting specific admission cut-offs. When one sets a cut-off, 
no difference in outcomes will occur for the students immediately above and below that cut- 
off one in at least 97.6% of cases and almost always in 98-99% of cases. Mortenson (1999) 
indicates that affluence relates far more with graduation and retention, and could reduce 
the incorrect decision rate from 98% to perhaps 70% of rejected applicants. 

Introduction and Background 

Because of recent increases in FTIC enrollment and projected future increases, and to 
provide improved information for admissions decisions, this study sought to determine 
what short- and long-term performance and attrition effects relate to student 
characteristics that are available to inform selection during the admissions process. 1 

An extensive literature on predictors of college success exists. Generally, the research 
indicates that high school grades are the best predictor, with such as race/ethnicity, sex, 
and standardized test scores providing some information. Test scores are commonly used 
as an admission requirement, however, the literature provides very limited support for their 
use. Elert (1992) summarizes the findings of many studies by stating that overall, previous 
grades are about twice as good as the SAT at predicting first semester grades. 2 The main 
justification for requiring the tests for admissions is that although the SAT is an inferior 
predictor relative to high school grades, it can increase the accuracy of prediction when 
used in combination with them. However, research indicates that inclusion of the SAT 
increases early grade prediction by an average of only 5%. The major reason that the 
benefits are so low is that the SAT provides redundant information. He notes: 

Marginal as they are, the predictions of first year grades are the test's most 

accurate forecasts. Correlations between scores and grades in later years, and 



1 Note that full-time enrollment and particularly full-time completion of hours (a proxy for affluence) is about as strong a predictor of 
outcomes as high school G.P.A., but is not available as a selection criterion. This is true for Graduate Students also. 

2 Even test makers themselves do not claim that standardized tests measure either achievement or school outcomes (Bracey, 1997). 
Test makers such as ETS and ACT do claim a low-level relationship with first semester college grades (Murphy, 2000; Elert, 1992). 
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overall college average, are lower still. One study found that the ability of college 
admission tests to predict grades declined consistently from one semester to the 
next throughout eight semesters (Humphreys). The virtual disappearance of the 
aptitude tests' ability to predict beyond the freshman year has been explained by 
some commentators as a result of the nature of advanced study. Multiple choice 
testing predominates introductory courses, they argue, but intermediate and 
advanced courses demand a broader range of performance. 

The Florida State University System (Florida SUS, 1995) conducted extensive research on 
traditional predictors of college success across the then nine SUS institutions, and 
concluded: 

The greatest single predictor of success in College is High School Grades. 

Two methods are most frequently used to quantify high school performance: High 
School G.P.A. and class standing or rank. Class standing is reported as a standard 
more often than is G.P.A. 

To give some idea of how extensive research conducted on standardized tests such as the 
SAT and ACT is, one of the highest relationships in the testing literature between the SAT 
and anything other than another test is a correlation of r = .66 reported by French & John 
(1967) between SAT scores and uric acid levels in the blood. Such ETS-sponsored studies 
clearly show just how widely ETS has searched for something their product predicts. 

Methods 

The following predictor variables (admissions characteristics) were submitted to analysis 
(Acronym used for each specific variable is in parenthesis): (1) High School G.P.A. (HS 
G.P.A.); (2) Graduating Class Rank (Rank) - Percentile Rank in High School Graduating 
Class (available for cohorts: 92 to 99); (3) Test Scores- Either the ACT or the combined 
SAT; (4) Minimum Test Scores - Scores at or below 440 on either the Quantitative or 
Verbal portion of the SAT and below 18 on the ACT; (5) Alternative Admits - Students who 
were either admitted below the BOR Sliding Scale or who lacked adequate academic credits 
for admission. (6) Race/ Ethnicity; (7) Sex; (8) Age .3 

The following outcome variables were submitted to analyses: first semester G.P.A., first 
year G.P.A., returning for the second year, long-term retention/graduation and 1-7 year 
graduation. For regression purposes, the retention/graduation variable was expanded to 
three ranks, with o=lost in 1 st year, i=retained two or more years, and 2=graduated. 

Variable Sources - All data were derived from official USF or BOR sources. 

Sample - The sample included all fall 1991 to fall 1999, summer and fall freshmen (FTIC). 

Analysis Issues : Parametric (OLS) correlations (Pearson r) consistently showed lower 
relationships between USF G.P.A. and incoming items (HS G.P.A. TEST Scores, etc.) than 
non-parametric (Spearman Ranks). Therefore, when attempting to determine whether 
additive effects occurred among any of the variables, I therefore ran backward elimination, 
robust regression analyses using rank transformed data. 

Limitations - Numbers reported in this study will not specifically match with those of any 
official IR reports, because only students listed in both the Admissions Files and Student 



3 Note that in this report, only measures 1, 2, 3, 6 and 7 are reported. For a more complete copy of the study, 
contact Ted Miccert: tmicceri@admin.usf.edu. 
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